Universal Access To All Knowledge
Home Donate | Store | Blog | FAQ | Jobs | Volunteer Positions | Contact | Bios | Forums | Projects | Terms, Privacy, & Copyright
Search: Advanced Search
Anonymous User (login or join us)

Reply to this post | Go Back
View Post [edit]

Poster: Bill Edger Date: Nov 9, 2003 8:36am
Forum: faqs Subject: Robots now blocks; old still there ?

A new company owning a domain is blocking my old domain with robots.txt copied below. If I took back ownership of the domain name is it possible that the previously archived contents will be there (I saw it previously) ? Or is it gone for ever ?
robots.txt :
User-agent: *
Disallow: /cgi-bin/
Disallow: /images/
Disallow: /js/
Disallow: /css/
Disallow: /CVS/

User-agent: ia_archiver
Disallow: /

User-agent: Scooter
Disallow: /

Terms of Use (31 Dec 2014)